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The  small  stations  operated  by  the  United  States  in  Antarctica  are 
manned  each  year  by  combined  groups  of  U.  S.  Navy  and  civilian  research 
personnel.  The  mission  of  the  military  group  is  that  of  maintaining  the 
stations  in  operating  condition,  while  that  of  the  civilians  is  to  collect 
scien+ific  data  in  various  disciplisies.  During  the  six  summer  months  all 
station  personnel  must  jointly  prepare  themselves  and  their  station  for 
the  winter  ahead.  Once  the  six  month  winter  sets  in,  the  station  personnel 
are  confined  to  the  interior  limits  of  the  station,  are  isolated  from  the 
outside  world  except  for  occasional  radio  coninunicstion,  and  each  man 
assumes  the  responsibilities  prescribed  b^’  h.ls  occupational  specialty. 

The  present  study  is  part  of  a  program  of  research  oriented  towards 
a  better  understanding  of  personal  adjustment  to  such  an  environment.  If 
we  can  presucte  adequate  adaptation  to  the  climatic  conditions,  the  p«i> 
sonnel  who  wintei>over  at  small  Antarctic  stations  oust  cope  with  the  two 
general  problems  of  carrying  out  one's  job  as  expected  and  getting  along 
with  others  in  a  confined  living  group  setting.  The  military  and  civilian 
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orgemizations,  to  which  these  personnel  are  responsible  for  their  work, 
are  able  to  make  general  evaluations  of  personnel  proficiency.  But  on 
the  basis  of  their  daily  contacts  with  one  another  and  their  adequate 
familiarity  with  the  goals  of  the  ejqpedition,  the  station  personnel  can 
readily  m?ike  evaluations  themselves,  both  in  regard  tc  work  performance 
and  social  adjustment  within  the  group.  Since  1957,  such  evaluations 
have  been  made  of  small  station  personnel  by  both  station  leaders  and 
peers. 

A  previous  report  (Gunderson  and  Nelson,  1962)  summarized  the  re¬ 
lationships  between  overall  adjustment  estimates  based  upon  ai-oraged 
ratings  by  supervisors  and  peers  during  the  wintering- over  period;  the 
stability  of  these  global  evaluations  over  time  was  also  studied.  In 
the  present  study  attention  is  focused  on  the  somewhat  more  specific 
rating  dimensions  on  which  evaluations  were  made  and  out  of  which  ths 
composite  evaluations  of  the  previous  study  were  formed.  Both  the  relia¬ 
bility  and  interrelationships  of  such  dimensions  are  preso.itly  assessed. 
Since  the  techniques  of  evaluation  varied  over  the  years,  a  separate 
analysis  is  offered  for  each  year.  Within  each  year  there  was  also 
variation  in  data  collection  schedules  and  completeness  of  data,  so 
sample  sizes  varj'. 

Deep  Freeze  1957 

Four  stations  of  Deep  Freeze  1957  were  studied.  At  the  end  of  the 
winter  period,  several  militarj'  and  civilian  supervisors  from  each 
station  evaluated  their  personnel  witii  a  foui'-category  rating  of  "overnll 
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performance"  and  or;  each  of  seven  specific  behavior  characteristics 
(Appendix  A).  Since  any  station  member  had  only  one  supervisor  to 
rate  his  effectiveness,  there  was  no  way  to  assess  rater  agreement.  The 
only  analysis  made  of  the  supervisor  evaluations  alone  was  that  of  com¬ 
paring  the  average  "overall  perfonaance"  ratings  for  personnel  described 
in  different  ways  on  the  seven  specific  behavior  characteristics.  In 
this  analysis  personnel  from  all  stations  were  pooled.  The  results 
appear  in  Table  1.  Supervisors  were  particularly  attentive  to  the  capacity 
of  an  individual  to  understand  and  carry  out  instructions  and  orders,  to 
be  neat  and  clean,  and  to  be  able  to  work  alone  without  recfjiring  others 
for  supervision.  The  absence  of  a  significant  relationship  between  per^ 
formance  and  being  a  disciplinary  problem  may  be  due  to  an  observed 
variation  among  supervisors*  judgments  as  to  what  constituted  a  discipli¬ 
nary  problem. 

At  two  of  the  four  stations  peer  evaluations  were  also  obtained  at 
ths  end  of  winter.  Each  station  member  was  rated  by  his  peers  on  twenty 
behavior  characteristics  (Appendix  B).  Positive  ratings,  those  judged  as 
favorable  to  the  ratee,  were  scored  by  the  authors  as  "+1";  negative  ratings 
were  scored  as  "-1".  These  scores  were  then  sunned  over  the  twenty 
characteristics  to  pro\Tlde  a  single  score  for  each  ratee  from  each  rater, 
h'hile  concealing  the  relationship  which  any  cue  beha^dor  characteristic 
might  have  had  with  "overall  perfonnanie",  this  method  provided  the  best 
diffi, rentiation  ef  ratets. 
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‘Overal]  performance  ratings  ranged  from  a  value  of  "i"  lor  poor  to  "4'’  for  outstzmding. 


Nelson  i:  Gunderson 


-5> 


Estimates  of  peer  rating  reliability  were  obtained  separately  for 
the  two  stations.  At  one  station,  v;here  every  pee.*  rated  all  other 
personnel,  the  raters  were  split  into  two  groups  by  taking  odd-even  names 
from  an  alpliabetical  roster.  Each  ratee  was  then  given  aii  average  peer 
rating  score  from  each  of  these  tv;o  rater  groups.  The  correlation  of 
these  two  scores  yielded  an  estimate  of  split-half  reliab.Llity  (r“.86, 
N“24)  significant  at  the  .01  level  of  confidence.  At  the  second 
station,  where  each  station  member  was  evaluated  by  one  or  more  peers  but 
never  by  the  entire  group,  rating  reliability  was  assessed  by  intraclass 
correlation  using  only  those  ratees  who  were  e%'aluated  by  more  than  one 
peer.  Agreement  among  raters  was  significant  at  the  .05  level  of  confi¬ 
dence.  The  data  are  presented  in  Table  2,  At  both  stations,  then,  there 
was  significant  agreement  among  peers  in  their  evaluation  of  station 
personnel. 


Table  2 

Analysis  of  Peer  Rating  Reliability 
Assessed  Through  Intraclass  Correlation 


Variance  Source 

Mean  Square 

df 

F  R 

Between  ratees 

219.35 

18 

2.142  .20 

Residual 

102.42 

48 

The  final  analysis  of  the  1957  data  was  the  comparison  of  peer  with 
supervisor  evaluations.  The  average  peer  rating  scores  were  compared  for 
personnel  judged  by  supervisors  as  "outstanding"  and,  "good"  (N-47)  against 
pi-sonnel  judged  by  supervisors  as  "average"  and  "poor"  (N-18).  A 
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point-bi serial  correlation  of  .49  was  obtained,  significant  at  the  .01 
level  of  confidence.  While  peers  and  supervisors  tended  to  agree  in  their 
evaluations  of  personnel,  the  magnitude  of  their  agreement  suggests  a 
lack  of  complete  communality  in  their  rating  frames-of-reference.  If  the 
supervisors  attended  to  both  job  performance  and  social  adaptation  in 
making  their  overall  judgments,  tha  peer  evaluations  should  correlate  with 
the  supervisors'  e\.*iuations  increasingly  well  to  the  extent  that  peers 
also  attend  to  both  job  ar,d  social  concepts.  Reference  to  the  peer  rating 
instrument  used  indicates  that  items  pertaining  to  job  performance  were 
more  prevalent  than  items  pertaining  to  social  adjustment. 

Deep  Freeze  1958 

At  oach  of  three  small  stations  ii;  Deep  Freeze  1958,  station  personnel 
were  e^/•aluatod  l)y  two  station  leaders  at  the  end  of  the  summer  period  and 
again  at  the  end  of  winter.  At  two  of  these  stations,  the  senior  military 
leader  evaluated  all  personnel  and  was  assisted,  independently,  by  a  junior- 
military  officer  in  evaluating  military  personnel  and  by  the  civilian 
leader  in  evaluating  civilian  personnel.  At  the  third  station,  the  senior 
military  leader  and  the  civilian  leader  evaluated  all  personnel.  Although 
ratings  were  made  on  each  of  nine  dimensions  (Appendix  C) ,  only  the 
following  were  studied:  adjustment  to  expedition  life,  ability  lo  get 
along  with  others,  ability  to  do  his  job,  and  overall  opinion.  Ihese  were 
dimensions  on  which  the  most  complete  data  were  obtained  and  represented 
the  adjustment  dimenaions  of  interest  in  this  study.  T!:'?e  analyses  v/ere 
p<^rformc-d  with  these  data:  assessment  of  rater  agreement  within  tii 
pcrioii,  consistency  of  ratings  over  time,  and  relationship  among  the 
rating  dimensions  within  time  period. 


N'^lson  &  Gunder.son  -7- 

Since  the  rating  distributions  of  individual  raters  tended  to  be 
skev/ed,  ratcc?  were  divided  as  close  to  the  median  as  possible  into  upper 
and  lov:er  groups  for  each  rater  on  each  dimension.  Contingency  coefficients 
were  then  computed  for  each  dimension  comparing  the  upper  and  lower  groups 
of  the  senior  military  leader  with  the  upper  and  lower  groups  of  either 
the  .-junior  military  leader  or  the  civilian  leader  as  appropriate.  The 
stations  were  pooled  in  this  analysis.  Table  3  contains  the  results  de¬ 
scribing  agreement  bet’-.’sen  leaders  within  each  time  period.  The  contin- 
ger.cy  coefficients  reported  throughout  this  paper  are  based  upon  2X2 
contingency  tables  and  have  been  corrected  for  a  maximum  possible  value 
of  .707  for  such  tables.  Also  shown  in  Table  3  are  the  estimates  of 
rating  consistency  ovei  time.  These  data  were  obtained  by  correlating  for 
each  dimension  the  average  leader  ratings  for  end  of  summer  with  the 
average  leader  ratings  for  end  of  winter.  The  results  indicate  rater 
agreement  within  time  period  and  consistency  of  average  ratings  over  time. 

Relationships  among  the  rating  dimensions  were  obtained  bj'  correlating 
avei aged  leader  ratings  across  dimensions.  These  results  appear  in  Table  4. 
Military  and  civilian  ratees  were  treated  separately  in  this  analysis  on 
the  assumption  tliat  different  aspects  of  performance  may  have  been  given 
different  weight  by  the  leaders  in  their  evaluation  of  these  two  types  of 
peisoiiiiel.  Ai  Uiougi.  the  Jiffereaeo  is  slight,  J^>b  performvance  was  somewhat 
more  related  than  social  adaptation  to  "overall  opinion"  ior  the  mi’itai-y 
personnel,  t.iiile  the  reverse  vas  observed  for  civilians.  If  there  is  any- 
thii.g  to  this  trend,  it  nay  be  due  to  greater  saliency  and  cruciality  o!' 
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the  military  jobs  in  regard  to  station  life.  In  general,  however,  the 
significant  ir.tercoTTclations  suggest  a  single  factor  of  adjustment  com¬ 
posed  of  bO'th  task  and  social  components.  The  dimension  oi  "adjustment  to 
expedition  life"  was  consistently  more  highly  related  to  social  than  job 
performance,  and  perhaps  this  dimension  was  perceived  by  the  leaders  as 
simply  another  way  of  expressing  the  ability  to  get  along  with  others. 

At  the  end  of  the  summer  and  winter  periods,  peers  at  each  of  these 
stations  evaluated  one  another  through  a  peer  nomination  questionnaire 
(Appendix  D).  Three  nominations  were  made  for  "remaining  with  mo  at  the 
station"  (Dare)  and  three  nominations  were  made  for  "going  with  me  or.  an 
overland  sled  party"  (Ice).  Values  of  "3",  "2",  and  "1"  were  assigned 
by  the  authors  to  first,  second,  and  third  choice*:  respectively,  A  choice 
sum  was  then  obtained  for  each  station  member  for  Base,  Ice,  and  total 
nominations  (Base  p]us  Ice).  Within  each  station,  personnel  were  divided 
u!  close  to  the  modian  as  possible  into  upper  and  lower  choice  groups  on 
each  nomination  index.  Since  there  were  generally  more  military  than 
civilian  personnel  at  these  stations,  and  nince  there  may  h,ive  been  a 
tendency  for  military  to  choose  military  and  civilians  to  choose  civilians, 
the  upper  and  lower  choice  groups  were  formed  separately  for  military  and 
civilian  personnel  iind  then  pooled. 

Contingency  coefficients  were  again  used  to  assess  the  relationship 
between  the  nomination  indices  within  and  between  time  periods.  These 
result.s  are  shown  in  Table  b.  Base  and  Ice  nominations  were  significantly 
related  within  each  time  period,  but  betwe*'n  time  periods  the  total  or 
composite  nomination  was  most  consistent. 
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Table  5 

Deop  Freeze  1958  Peer  Evaluations:  Contingency  Coefficient  Relation- 
ships  between  Peer  Nomination  Indices  vfithin  and  betv/een  Time  Periods 


Relation ship 


N 


r 


c 


p 


Sumner 

Base  with  Summer  Ice 

S3 

.,50 

<.01 

Winter 

Base  with  Winter  Ice 

69 

.51 

<.01 

Sumer 

Base  with  Winter  Base 

53 

.24 

Suiuner 

Ice  v/ith  Winter  Ice 

53 

.44 

<,05 

Summer 

Total  with  Winter  Total 

53 

.64 

<.01 

In  Table  6  the  relationship  bet:;een  peer  and  loader  evaluations  is 
shown.  Point-bi serial  correlations  wore  used  to  compare  upper  and  lower 
peer  nomination  choice  groups  on  averaged  leader  ratings.  Base  nominations 


Table  6 

Deep  Freeze  1958  Peer  and  Leader  Evaluations:  Point-bi serial  Correla- 
tions  oetween  Peer  Nomination  Indices  and  Leader  Evaluations. 


Leader  Evaluations 

SuiToner 

Peer  Evaluations 

Winter 

Base 

Ice 

Total 

Base 

Ice 

Total 

Adjustment/expodition 

.35""^ 

.17 

.18 

.21 

.22 

.17 

Gets  along  with  others 

.36^^ 

.30** 

.31** 

.37^^* 

.27 

,40*^ 

Does  his  job  well 

.24* 

.15 

.26* 

.22 

.03 

.13 

Overall  opinion 

.45^^* 

.22* 

.37"^* 

.26 

.10 

.15 

N 

84 

84 

84 

50 

50 

50 

.  .  . 

Significant  at  the  ,05  level  of  confidence 


'"‘Significant  at  the  .01  level  of  confidence 
were  generally  more  higl.ly  related  tu  each  of  tne  leader  evaluations  thaji 
were  the  Ice  ncsninations  made  by  peers.  There  was  some  indication  t..at  Ice 
nominations  were  related  to  occupation;  that  is,  "it  would  be  good  to  have 
a  glaciologist  along  because  of  his  specific  knowledge  and  skills  on 
tlx-  ice."  Selections  for  Base  at  the  end  of  suimtier  were  related  to  each 
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of  the  leader  evaluation  dimensions,  while  at  the  end  of  winter  they  were 
significantly  related  onlj'^  to  leader  ratings  of  compatibility’.  The  ability 
to  get  along  with  others,  or  compatibility,  was  the  one  leader  dimension 
most  consistently  related  to  the  peer  nomination  indices.  The  finding  that 
leader  ratings  on  compatibility  increase  ovei‘  time  in  their  relationship 
to  the  composite  peer  nomination,  while  leader  ratings  on  job  performance 
decrease  over  time  in  the  same  regal’d,  suggests  that  peers  attached  in¬ 
creasing  importance  to  social  rather  than  work  adjustment  through  the  winter. 

In  summary,  rating  agreement  between  leaders  was  observed  within  each 
time  period.  Ev’aluations  were  also  consistent  over  time,  with  "overall 
opinion”  of  loaders  and  the  composite  nomination  by  peers  being  most  con¬ 
sistent.  'dule  both  job  po-^^nnance  and  social  adjustment  were  highly 
correlated  with  leaders*  overall  opinions  at  both  time  periods,  social 
adjustment  appeared  somewhat  more  related  than  job  performance  to  the 
peer  evalualions,  particularly  at  the  end  of  winter. 

Deep  Freesv  19G0-196L 

In  Deep  Freeze  1960,  data  were  collected  from  two  stations.  There 
wore  no  peer  evaluations.  Ai  the  end  of  winter  the  military  and  civilian 
leader  from  each  station  rated  every  man  on  each  of  twenty-one  behavior 
characteristics  (Appendix  E),  and  ranked  all  station  persoraiel  in  the  order 
in  which  thty  would  select  thua  to  serve  at  an  Antarctic  station,  assumed 
by  the  authors  to  be  an  overall  evaluation.  In  Deep  Freeze  1161  the  two 
station  leaders  evaluated  station  personnel  by  the  some  method  described 
above,  but  made  evaluations  at  the  end  of  summer,  at  mid-winter,  and  still 
again  at  the  end  of  winter.  Peer  nominations  were  also  obtained  at  each 
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of  the  above  time  perioas.  Data  were  so  obtained  from  three  small 
staiions.  Tn  the  present  analysis,  the  tv.o  Deep  Freeze  years  were  pooled 
wherever  there  were  common  data. 

The  first  analysis  vaa  that  of  assessing  agreement  beti^een  leaders 
on  their  overall  ranking  of  personnel  within  esich  time  period.  In  some 
instances,  one  station  leader  categorized  his  personnel  rather  than  ranking 
them.  At  no  station  did  both  leaders  do  tliis  at  the  same  time  period. 
Therefore,  after  transforming  ranks  to  T  scores,  point-biserial  correlations 
wore  computed  in  instances  where  one  leader  categorized  personnel,  tmd 
Pearson  product-moment  correlations  were  computed  when  both  leaders  gave 
ranks.  For  each  station,  then,  a  correlation  was  obtained  between  the 
two  leaders  on  their  overall  evaluation  at  each  time  period.  These  corre¬ 
lations  were  averaged  over  stations  to  give  an  estimate  of  leader  agree¬ 
ment  within  each  time  period.  By  a  similar  method,  an  estimate  of  the 
consistency  of  evaluations  between  end  of  summer  and  end  of  winter  also 
wa.s  obtained.  These  results  appear  in  Table  7, 

Table  7 

Deep  Freeze  19G0-19C1  Leader  Overall  Evaluationsj 
Agreement  between  Leaders  vathin  Time  Period  and 
Consistency  of  Evaluations  over  Time _ 


Time  Period 

N 

Avg.  r 

P 

Summer 

Ih 

.22 

Mid-winter 

.33 

rnd  of  winter 

ic. 

<.to 

S  natr-F-nd  of  wir.tcr 

Id 

.3-1 
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On  the  overall  ranking,  there  uas  an  increase  in  leader  agreement 
over  time,  but  in  general  the  agreement  v;as  not  so  good  as  that  observed 
between  leaders  in  previous  data.  Perhaps  the  method  of  ranking  required 
greater  differentiation  than  the  leaders  vjere  reliably  able  to  make.  It 
also  is  possible  that  experience  as  a  supervisor  may  be  important  in 
personnel  evaluation.  In  Deep  Freeze  1958,  station  military  leaders  were 
Navy  line  officers  experienced  in  rating  their  men.  In  the  present  years, 
the  military  leailers  are  Navy  Medical  Officers  whose  experience  in  the 
Navy  and  probably  in  evaluating  personnel  is  limited.  Nevertheless,  there 
were  in  1900  and  1961  differences  between  pairs  of  leaders  in  the  extent 
to  which  they  agreed,  suggesting  individual  differences. 

The  peer  evaluations  obtained  in  1961  consisted  of  three  nominations 
for  each  of  the  following:  most  and  least  likeable,  knows  most  and  least 
about  his  job,  adjusts  best  and  poorest  to  the  group,  and  would  like  or 
not  iiho  to  bo  marooned  with  this  person  on  the  ice,  Since  two  of  the 
three  stations  offered  incomplete  data  over  the  last  two  tiae  periods, 
peer  evaluations  were  pool<“d  over  stations  and  lime  periods  for  most 
of  bic  following  analyses.  Consistency  of  peer  evaluations  was  assessed, 
however,  through  a  correlation  of  peer  scores  obtained  at  the  end  of 
summer  with  an  average  of  the  peer  scores  obtained  in  the  two  winter 
periods.  Values  of  "+3",  "+2",  and  "+1"  were  given  by  the  authors  for 
positive  first,  second,  and  third  choices  respectively;  values  of  "-3", 
"-2",  and  "-1"  were  given  for  negative  first,  second,  and  third  choices 
respectively.  Choice  scores  were  sumed  for  each  ratee,  and  on  each 
nomination  index  personnel  within  each  s'.ation  were  divided  as  close  to 
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the  median  as  possible  into  upper  and  lower  choice  groups.  Military 
and  civilian  personnel  were  drawn  from  the  same  pool  since  they  were 
approximately  equal  in  number  at  these  stations.  Contingency  coefficients 
vjere  computed  to  estimate  the  relationship  between  the  peer  nomination 
indices.  These  are  shown  in  Table  8. 

Table  8 

Deep  Freeze  1961  Peer  Evaluations;  Relationships  among  Peer 
Nomination  Indices  and  Test-retest  Stability  of  Evaluations 


between  End  of  Summer  and  End  of  Winter.^ 


(2) 

(3) 

(4)  Tost-retest 

(1)  Likeability 

.50 

.63 

.54 

.46 

(2)  Knows  job 

.53 

.58 

.73 

(3)  Adjusts  to  group 

.78 

.45 

(4)  Would  like  to  be  with 

.53 

if  marooned  or  lost 

Contingency  coefficients;  for  all  values  p*.05  (N"58). 


The  1961  peer  evaluation  data  suggest  a  general  evaluative  factor 
composed  of  both  job  and  social  adjustment  components,  very  similar  to 
the  results  obtained  from  the  1958  lo*df‘r  evaluation  data.  Consistency 
of  evaluations  over  time  is  indicated,  particularly  with  regard  to  job 
knowledge.  Again,  adjusting  to  the  group,  or  compatibility,  appears 
most  higlily  related  to  the  more  general  nomination  dimension  pertaining 
to  t)eing  marooned  or  lost  with  a  person. 

I'or  the  Deep  Freeze  1961  stations,  peer  evaluations  w 're  compared 
with  leader  evaluations.  Pooling  data  over  the  three  time  periods,  per¬ 
sonnel  a:  each  station  were  divided  into  upper  and  lower  groups  based 
upon  averaged  leader  rankings.  Personnel  liad  already  been  so  divided  on 
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the  basis  of  peer  nomination  stores.  Contingency  coefficients  were 
then  used  to  assess  the  relationship  between  each  peer  nomination  index 
and  the  overall  leader  evaluation.  The  results  appear  in  Table  9.  Peer 
evaluations  of  compatibility  were  more  highly  related  to  leaders*  overedl 
ranking  evaluation  than  were  any  of  the  other  peer  nomination  indices. 

Table  9 

Deep  Freeze  1961  Peer  and  Leader  Evaluations!  Contingency 
Coefficients  Estimating  the  Relationship  between  Peer  Nomina- 
tion  Dimensions  and  Overall  Evaluations  by  Leaders 


Peer  Nomination  Dimensions 


Overall  Leader  Evaluation 
N  o 


Likeability 

36 

.45 

C.05 

Knows  job 

36 

.14 

Adjusts  to  group 

36 

.63 

<.01 

Would  like  to  be  with 

36 

.38 

<.10 

if  marooned  or  lost 


In  the  19S8  stations,  it  appeared  as  thougn  the  station  leaders 
included  both  job  and  social  adjustment  components  in  their  "overall 
opinions",  while  the  pee  s  seemed  to  be  somewhat  more  oriented  towards 
social  adjustment  or  compatibility.  Data  from  the  1961  stations  suggests 
that  the  reverse  may  be  true.  While  the  peers  did  attend  highly  to  com¬ 
patibility,  they  also  included  job  knowledge  in  their  general  evaluation, 
assuming  choice  "to  bo  marooned  with"  as  the  most  general  evaluation 
made  by  pt^rs.  On  the  other  hand,  the  1961  leaders  gave  overall  evalua- 
tiwns  based  much  more  on  compatibility  than  on  job  knowlodge,  as  measured 
by  the  pv.r  nominations.  There  may  be-  a  subtle  diffe-rence  between  kn^wini 
about  one's  job,  as  mcasurvd  la  1961,  and  in  doing  one's  job  well,  as 
measured  in  1958,  but  the  two  indices  of  job  orientation  should  be  posi¬ 
tively  correlated. 
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To  better  understand  the  fraiuc-of-referonce  used  by  the  1960  and 
19bl  leaders  in  Ihoir  -iverall  rankinp,  judjroents,  analysis  of  ratings 
on  the  twenty-one  specific  behavior  characteristics  was  condvo+od.  For 
each  station  leader,  at  each  time  period,  the  twenty-one  behavior  rating-s 
were  correlated  with  the  ove''all  ranking  evaluation.  Point-biserial 
correlations  were  obtained  betwe  'n  average  ratings  I'n  the  behavior 
characteristics  and  dichotomous  classifications  on  "overall  evaluation". 
Although  some  differences  were  noted  ajnong  leaders  and  time  periods,  a 
single  estimate  of  each  relationship  was  obtained  by  averaging  the  correla¬ 
tion  values  over  leaders  and  time  periods.  Agreement  b'^tween  pairs  of 
station  li aders  on  their  behavior  ratings  was  also  assessed  by  averaging 
intor-rator  correlations  over  time  and  stations.  Relationships  also  were 
obtained  between  average  ratings  on  behavior  characteristics  and  dichotomous 
classifications  on  poor  nominations  pertaining  to  "being  marooned  with  on 
the  ice."  Point-biscrial  con elations  were  obtained  for  each  station; 
average  correlations  were  then  computed.  The  results  of  these  three- 
analysis  are  shown  in  Table  10. 

The  magr.jtud..s  of  relationship  between  the  behavior  ratings  and  the 
general  leadir  and  peer  evaliations  were  reasonably  similar.  Dimensions 
pirtainint;  specifically  to  ,iob  or  work  jjerformancfc  were  more  highly  related 
to  peer  evaluations  tlian  to  leader  evaluations,  supporting  previously  re¬ 
ported  data  for  these  groups.  Both  peers  and  leaders,  h'-  'ever,  attended 
to  social  adaptation  in  makin-;  thtir  evaluations  of  personnel.  Chars '’terist ics 

n  /V  f  it  1  •*  V  ^  ^  ^  mm  ^  m  t  mm  *1  *  — 

i'i  ii\>2  ‘X 

evaluations  were  " I iki abi 1 i t . "  and  "daily  routine  performance".  The  lattir 
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Table  10 

Dtep  Freeze  1960-1961  Peer  emd  Leader  Evaluations:  Average  Agreoiaent  between 
Leaders  on  Behavior  Cuaracteristic  Ratings  and  the  Average  Relationship  of 
such  Behavior  Ratings  with  1)  Overall  Leader  Evaluation  and  2)  General 
Dimension  of  Peer  Evaluation.^ 


Avg.  Agreement 

Behavior  Characteristic  Rntween  Tiiodors.  . 

Overall  Leader*^ 
Evaluation 

General  Peer‘d 
Evaluation 

Adapts  to  change 

.17 

.44 

.50>> 

Controls  emotions 

.54^- 

.50*^ 

.42 

Expresses  anxiety 

.40 

-.36 

-.35 

Muscular  tension 

.23 

-.42 

-.38 

Accepts  authority 

.61^^^ 

.46 

.25 

Excitability 

.35 

-.58 

-.36 

Maturity 

.44 

.46 

.32 

Self-conf idence 

.15 

.18 

.24 

Motivation  to  do  one’s  job 

.30 

.44 

.59^- 

Likeability 

.58^‘ 

.55*^ 

.47** 

Alertness 

.31 

.41 

.41 

Leadership 

.43 

.45 

.31 

Industriousness 

.39 

.42 

•  bt> 

Problem- shari ng 

.16 

.11 

00 

Agrossiveness 

.40 

-.10 

-.04 

Happiness 

.38 

.42 

.52" 

Outwaixi  leaction  to  frustration 

.40 

.05 

-.29 

Motivation  to  belong  to  group 

.30 

.50^* 

.46 

Attitude  towards  Deep  Freeze 

.28 

.44 

.69"" 

Satisfaction  with  assigninent 

.32 

.46 

fil"" 

Daily  routine  performance 

.53*^ 

.55'' 

.66"" 

N 

18 

18 

10 

^Pearson  product-moment  correlations  used  for  leader  agreement;  point- 
biserial  correlations  used  for  relationships  with  leader  and  peer  evaluations. 
For  each  station  group  included  in  these  analyses,  N»1U.  The  correlations 
reported  are  averages  based  upon  two  or  more  groups. 

*^"0rder  the  mon  as  you  would  choose  them  to  serve  wi th  you  at  an  Antarctic 
station", 

‘'"'•'id  t  men  wou'Jd  you  like  (and  not  like)  to  be  marooned  or  lost  on  thi  ice 
with"? 


^'Significant  at  tnt  .05  level  of  confidence. 
^'^\Signi f leant  at  th<j  .01  levei  of  coniidence. 
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dimension  prcoably  approximates  a  general  evaluation  move  thcin  any  of  the 
other  behavior  dimensions,  and  it  is  encouraging  to  observe  leader  agreement 
on  such  a  dimension,  particularly  when  leader  agreement  was  relatively  low 
on  the  overall  ranking. 

Discussion  aiid  Conclusions 

Personnel  evaluations  made  by  Deep  Freeze  small  station  leaders 
and  peers  appear  reliable  both  within  and  bo+v/een  assessment  time  periods. 
Perhaps  greatest  variability  in  rating  reliability  lies  in  the  evaluations 
rendered  by  station  leaders.  In  1958,  the  most  general  evaluation  made 
by  loaders  was  their  “overall  opinion"  of  station  personnel;  on  this  rating 
dimension,  there  was  significant  agreement  between  station  leaders  both 
within  and  between  time  period*).  Presumably,  the  most  general  evaluation 
made  by  station  leaders  in  1960  and  1961  was  a  ranking  of  personnel  “in 
the  order  in  which  you  would  want  them  with  you  at  an  Antarctic  station." 
Leader  agreement  was  much  lower  on  this  evaluative  dimension.  It  has 
already  been  suggested  that  perhaps  experience  as  a  supervisor  may  be 
important  as  a  deierminant  of  reliable  supervisor  ratings,  and  the  1958 
military  leaders  were  probably  more  experienced  in  this  sense  than  the 
military  leaders  in  1960  and  1961.  For  both  time  periods,  the  civilian 
leaders  wore  probably  similar  in  supervisor  experience.  In  keeping  with 
the  idea  that  rater  experience  is  iaportd.nt  was  the  finding  in  both  1958 
and  lOi’iO-lOGi  that  agreement  beti/een  leaders  increased  over  time. 

Aside  from  rater  experience,  the  nature  of  the  evaluation  question 
must  also  oe  considered  in  terns  ol  its  potential  effect  upon  rating  rdi  i- 
bilitv.  What  are  the  similarities  and  differences,  for  example,  in  tiie 
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frames-of-reference  used  by  leaders  in  responding  to  a  question  about 
"overall  opinion"  as  contrasted  with  a  question  about  "desirability  of 
being  '..’ith  at  an  Antarctic  station"?  Is  the  latter  question  subject  to 
a  It  ore  idiosyncratic  frajie-of-referencc  than  the  former  question,  and, 
hence,  a  potentially  lower  level  of  inter-rater  reliability?  As  the  ques¬ 
tions  asked  of  leaders  become  more  similar  in  content,  there  is  evidence 
that  evaluations  based  upon  such  questions  can  be  made  more  reliably.  The 
leaders  in  19(X)  and  1961,  for  example,  reamed  significant  levels  of  agree¬ 
ment  v;hcn  evaluating  station  personnel  on  "how  well  the  group  liked  them" 
and  "daily  routine  performzince, "  in  much  the  same  way  that  the  leaders  in 
lS5o  wore  able  to  roach  significant  levels  of  agreement  on  "how  well  does 
he  get  along  V7ith  others  in  the  group"  and  "how  well  docs  he  do  his  job". 

It  might  simply  be  that  peer  nominations  on  general  aspects  of  performance 
are  a  more  reliable  source  of  evaluation  than  leader  ratings,  particularly 
when  one  or  both  of  two  leaders  are  relatively  inexperienced  in  serving  as 
supervisors.  In  such  instances,  the  loaders  might  in  fact  be  considered 
as  but  two  peers,  and  their  agreement  with  one  another  should  be  expected 
to  be  no  greater,  and  perhaps  less,  than  that  between  ether  gioup  members. 

The  extent  to  which  leaders  and  peers  have  included  both  jv)0  and 
social  adjustment  components  in  their  overall  evaluations  of  station 
personnel  has  varied  over  the  years.  In  139"),  station  leaders  included 
both  job  and  social  adjustment  m  their  overall  evaluation*',  while  poors 
in  ttuil  year  atteiuled  somewhat  more  to  social  adjustment  or  compatibility 
than  to  job  performanc*;.  In  iv< ! ,  on  the  othei  hand,  peers  included  botn 
J'.c  job  and  social  adjustment  .isjH'cts  of  bcnavior,  even  favoring  th*’  fomer, 
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while  the  station  leaders  generally  attended  more  to  the  social  adjustment 
aspect  of  behavior.  One  hypothesis  to  account  for  this  trend  is  that  job 
performance  is  given  greater  emphasis  as  p*rt  cf  an  overall  evaluation  as 
the  number  of  years  of  work  experience  of  the  raters  increases.  Just  as 
the  1958  military  leaders  were  probably  more  experienced  in  tlie  Na’.’y  than 
the  1960  and  1961  military  leaders,  militV'y  enlisted  personnel  of  1960 
and  1961  stations  tended  to  be  older  and  had  more  time  in  service  than  those 
of  the  1958  stations. 

Results  of  the  present  study  do  suggest  one  very  important  notion 
about  adjustment  in  small  confined  living  groups  such  as  those  in  the 
Antarctic.  Compatibility,  or  fitting  in  with  the  group,  is  at  least 
as  important  as  job  performance  in  the  eyes  of  both  leaders  and  peers. 

This  finding  suggests  that  doing  one's  job  well  may  be  a  necessary  but 
not  sufficient  quality  for  good  overall  adjustment  in  this  environment. 

Uhile  there  may  be  differences  depending  upon  the  occupation  to  which  one 
nifers,  it  might  be  that  there  is  greater  tolerance  of  ]ess  adequate  job 
performance  for  persons  who  are  personally  well  received  by  other  group 
members  than  for  persona  not  so  well  received.  Sir-ce  ratings  of  job 
performance  and  social  adjustment  are  positively  correlated  in  the  results 
of  this  paper,  tho  authors  speculate  that  willingness  to  work  is  more 
critical  thrm  slieer  proficiency  of  work.  Ii.  any  case,  the  fact  that  com¬ 
patibility  is  so  important  poses  a  challenge  for  most  who  orv  charged 
wit!i  the  rcsponsiblity  of  selecting  ana  grouping  personnel  for  smalt 
Antarctic  stations.  Consideration  of  individual  personalities  and  group 
composition  t>«comes  an  apparent  nc-ed  in  the  selection  and  assignment 


procesr . 
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Appendix  A 

1957  Supervisor  Evaluation^ 

NViat  is  your  overall  ev^l-iation  of  tiiis  man? 

{  )  poor  (  )  average  (  )  good  (  )  outstanding 

1.  In  the  company  or  group  to  which  he  is  assigned: 

+  He  does  not  let  others  push  him  around,  but  does  not  look  for  trouble 
lie  lets  others  take  advantage  of  him 
He  is  often  arguing  or  picking  fights 

2.  With  regard  to  his  ability  to  learn  and  use  what  he  k  /ws: 

+  He  has  no  difficulty  learning  or  carrying  out  instructions 
lie  is  slow  in  learning  but  eventually  gets  it 
He  is  unable  to  understaiid  or  cany  out  simple  instructions 
He  seems  to  understand  instructions  but  can't  caiTy  them  out 

3.  He  responds  to  orders  und  instructions: 

+  With  initiative 

+  Accepting  without  comment 

Obviously  resents  orders  but  responds  adequarely 
Poorly  and  with  resentment 

4.  During  free  periods: 

+  He  stays  off  to  himself 

He  is  a  loader  of  group  activity 
He  is  usually  a  part  of  the  group 

5.  With  regard  to  himself  and  his  clothes: 

1  He  is  unusually  neat  and  clean 
He  is  up  to  par  with  his  shipmates 
He  IS  objectionably  dirty  and  untidy 

f).  Has  he  been  a  disciplinary  problem  (explain): 

+  No 
Yos 

7,  When  faced  with  a  task,  ho  works  bettor: 

♦  Vihon  he  works  alone 

When  lie  works  vith  one  or  more  persons  with  no  designated  leador 
Hhen  he  works  with  a  group  and  needs  supervision  every  step 


3 

(♦)  <igns  before  boha-'ior  clwiracttri sties  indieate  those  descriptions 
‘K'ljttod  in  this  study  for  differentiating  upper  and  lower  groups  on  ovi-raJl 
perforoanve . 
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1S57  Peer  Rating 


Strongly 

Strongly 

Disagree 

Disagree 

Undecided 

Agree 

Agree 

1.  Tins  man  shows  confidence  in  himself. 

2.  His  appearance  is  good. 

3.  He  s’liovn  leadership  in  his  field. 

4.  Ho  has  the  ability  to  stand  up  under  pressure, 

5.  He  takes  the  initiative. 

6.  He  IS  a  fine  athlete  and  enjoys  sports, 

7.  He  is  \/oll  educateu. 

8.  This  man  has  command  presence. 

9.  He  has  stamina  and  endurance. 

10.  His  actions  show  that  he  has  familiarity  with  many  things. 

11.  He  exhibits  imagination  in  solving  problems, 

12.  This  man  thinks  quickly  and  well  in  a  crisis. 

13.  He  is  tiie  type  of  man  wno  will  carry  through  in  any  situation 

14.  He  exhibits  poise  in  most  situations, 

15.  He  has  personal  pride  in  himself  and  his  work. 

16.  His  decisions  show  sound  judgment. 

17.  He  performs  well  before  the  group. 

18.  ilo  bas  experience  in  military  line  and  uses  tiiis  co  ad-^antage 

19.  He  has  good  training  and  knows  his  duties  and  responsibiiitie 

20.  Hen  v;ould  follow  him  gladly. 
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outstanding  better  than  average  satisfied  vith  nim  b*.  low  average 
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Appendix  U 

1958  Peer  Nominations 


1.  If  only  three  other  men  from  your  immediate  group  could  be  left 
with  you  to  man  this  station,  while  all  others  had  to  leave  on 
an  important  mission,  which  tliroe  men  would  you  choose  to  stay 
with  you? 


2.  If  you  could  take  three  men  from  your  immediate  group  to  accompany 
you  on  a:i  overland  sled  part  which  was  to  accomplish  an  important 
mission,  which  three  men  would  you  choose? 


Nelson  &  Gunderson 
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Appendix  E 

1360-1961  Supervisor  Evaluations^’ ° 

1.  How  adaptible  is  he  to  cVianges  and  new  situations? 

2.  How  well  does  he  control  his  emotions? 

d.  ”ow  anxious,  worried,  or  upset  docs  he  generally  appear? 

4.  !Iow  tense  does  thi«  person  usually  appear? 

5.  How  accepting  is  iie  of  authority? 

G.  How  exciteable  does  he  generally  appear? 

7.  Considering  his  age,  how  mature  does  he  seen  to  be? 

H.  How  self-confident  is  this  person? 

9,  How  motivated  is  he  in  carrying  through  with  assignments? 

10.  How  well  liked  is  this  person  by  others  in  the  group? 

11.  How  alert  is  thjs  person? 

12.  How  much  leadership  ability  does  he  display? 

13.  ,,ow  energetic  or  industrious  is  this  person? 

14.  To  what  extent  does  he  attempt  to  share  his  problems  with  others? 

15.  How  ngressivc  is  this  person? 

If'.  How  happy  does  this  person  generally  seem  to  be? 

17.  How  does  he  react  to  frustration,  outwardly  or  inwardly? 

18.  How  noti'/ated  is  tnis  person  to  be  an  efficient  member  of  tH«'  group’ 

19.  How  favorable  are  iiis  altitudes  towards  the  Deep  s'Tceze  projects? 

20.  How  satisfied  is  tliis  person  with  Iiis  present  assignment? 

21.  How  favorable  is  this  person's  perforraanra  under  row’ine  conditions? 


liank  the  men  at  this  station  in  the  order  in  which  you  wculd  choose  ttiem 
xo  serve  with  you  at  an  Antarctic  station. 


^.’esponst  to  Items  1-21  is  given  on  a  nine-point  rating  scale. 

Personal  Adjustment  Rating  Booklet  (Modified  Deep  Frsjcze)  prepare'l 
by  BfiijiUi'.in  B.  We^urew,  fh.D. ,  H.S.N’,  Medical  Research  laboratory,  U.S.  t. 
sutxaarine  Uasv;  NVv  London,  Conn. 
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Appendix  F 

1961  Peer  Nominations 

1.  Name  the  three  men  in  this  group  you  find  most  likeable. 

Name  the  three  men  in  this  group  you  find  the  least  likeable. 

2.  Marne  the  throe  men  in  this  group  you  think  know  their  jobs  best. 

Name  the  three  men  in  this  group  you  think  know  their  jobs  least. 

3.  Naiiic  the  three  men  you  think  adjust  best  to  the  group. 

Name  the  three  men  you  think  adjust  most  poorly  to  the  group. 

4.  Name  the  three  men  you  would  choose  first  to  be  with  if  you  wore 

suddenly  marooned  or  lost  in  the  Antarctic, 

Name  the  three  men  you  would  choose  last  to  be  with  if  you  were 
suddenly  marooned  or  lost  in  the  Antarctic. 
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